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kindergarten through second-grade work. Among the surprising answers 
to these questions are the following: (1) the length of the school 
day did not predict kindergarten children's school achievement; (2) 
individual teachers' behaviors were quite stable both from morning to 
afternoon and from year to year? (3) whole-class reading instruction 
produced the greatest gains in student achievement :n reading? (4) 
teachers' instructional practices mediated children's peL-^f ormance on 
criterion-referenced measures? and (5) elementary-grade science 
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Abstract 

In the course of a longitudinal study that has addressed the questions of how children learn to 
comprehend what they read and how they learn science concepts, many other research questions have 
emerged This report first presents the context of the longitudinal study and the methodology used to 
conduct the work^ and then focuses upon 14 different research questions that emerged in the 
kindergarten through second-grade work. Among the surprising answers to these questions are the 
following: (a) the length of the school day did not predict kindergarten children's school achievement; 
(b) individual teachers' behaviors were quite stable both from morning to afternoon and from year to 
year; (c) whole-class reading instruction produced the greatest gains in student achievement m reading; 
(d) teadien' instructional practices mediated children's performance on oiterion-referenced measures; 
and (e) elementary-grade science textbooks were quite considerate to students. 
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WHEN IN THE COURSE OF A LONGITUDINAL STUDYj 
DIFFERENT QUESTIONS AND SURPRISING ANSWERS 



In the course of our longitudinal study researching how children develop the ability to comprehend what 
they read and how they learn science concepts, numerous other questions have emerged. Although each 
of these questions is outside the global questions of the larger study, they are in and of themselves 
interesting topics to pursue. This report will focus on 14 of thcsb questions. They are as follows: 

1. Are entering ability and teacher behavior belter predictors of student achievement than is length 
of school day? 

2. Do kindergarten children exhibit metacognitive ability? 

3. Are teaching behaviors within districts stable? 

4. Are individual teadiers' behaviors stable over time? 

5. Does whole-dass instruction in kindergarten produce higher student achievement in reading than 
does instruction in groups? 

6. Does whole-class instruction continue to produce the highest student achievement in reading in 
first grade? 

7. What is the relationship between the time teachers spend reading to their students and the time 
they spend teaching reading? 

8. Does comprehension monitoring ability continue to develop in first grade? 

9. Do at-risk stucents receive different instruction than do students who are not at risk? 

10. Are first- and second-grade basals alike? 

It Does teaching mediate students' science performance on criterion-referenced measures? 

12. Are science textbooks "considerate" to students? 

13. How do second-grade students in whole-class reading instruction compare to students in traditional 
classrooms? 

14. Do parents from different school districts respond consistently to science questionnaire items? 

This report wiUbegm by presenting background information about the kwgitudinal study to provide the 
context m which these questions arose. It witt then proceed to address the specific questions. The 
discussion will draw information from a potpourri of areas, including the systematic analyses of basal 
readers and science textbooks and classroom observations. 

Context 

In 1982, personnel from the National Institute of Education (NIE) approached the Center for the Study 
of Reading with the request that Center researchers undertake a longitudinal study of how children learn 
to comprehend what they read. It was the position of the NIE that while there are hundreds, perhaps 
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thousands of pieces of research that address many aspects of reading development, there has never been 
a comprehensive study of the relative impact of numerous influences upon a large group of children's 
reading comprehension development over time. 

Before our research team began this study in the fall of 1963, the senior staff decided to focus ultimately 
on children's abilities to read science text as the primary indicator of their ability to 'read to learn.' 
Thus, we conceptualized this program of research as two loqptudinal studies running in tandem and 
converging on reading in science as a content area by fifth grade. Our kwg-term goal was to produce 
causal models to exjriain why some children have learned to comprehend what they read better than 
others, as well as why the same children (or others) have learned more science concepts and processes. 
The study was {rianned to focus on two cohorts of children (about 325 per cohort) from kindergarten 
through at least fifth grade in reading and tbro*igh sixth grade in science. 

The Heuristic Model 

The simplest way to think about the development of reading comprehension and of science knowledge 
is to view each as a function of the aptitudes and abilities children posses as they enter school That 
is, what and how much children learn about science and reading in the early grades directly reflects their 
aptitude or verbal atMlity. A somev^ more complex view sees learning as a reflection both of 
duldren's I4>titudes and of home-related factors, such as sodoeconomic status and the amount and kind 
of stimulation provided by parents. Reading comprehension development and science knowledge 
development can also be seen as a function of the amount and kind of instructional activities children 
receive in school In addition, students may be vkwtd as contributing to their own knowledge 
development through the reading they do, the television programs they watch, and the activities they 
choose. 

To guide our work each year, we devek>ped a simple heuristic model (Meyer, Linn, &. Hastings, 1962b). 
The model reflects our belief that science knowledge and reading comprehension development are the 
result not only of student ability and prior opportunity to learn but also of immediate school and home 
support Figure 1 illustrates the relationships among these factors. 

[Inscft Flgnre 1 about here.] 

The model is composed of eight constructs: htraie background characteristics, student ability at the time 
they began school, the characteristics of instructional materials used to teach science, teachers' 
management style, teachers' instructional style, home support for science knov/ledge development, 
student ability at the end of each year, and independent reading. 

The foQowing discussion e]q)lains how we conceptualized each construct 

L Home bnckground. This construct represents the wiables of parental occupation and education, 
the number of adults in die home, the number of older and younger siblings, and the number of hom's 
each parent works outside the h(Hne each week. 

1 AbUfly, 0. This construct represents children's verbal abilities upon entering school that are most 
likely to affect their reading ability or science knowledge at the end of kmdergarten. Ability 0 on the 
model represents the children's abilities at the first testing in the fall 

3. Materials. This construct represents the characteristics of instructional materials that may contribute 
to children's reading or science development SpedficaUy, it represents the variables of textbook 
content, use, and "considerateness'-that is, the number of problems in the way science textbooks or 
basal readers present material 
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4. Maotfonent style. Because we believed that teadiers do nol necessarily manage their classrooms 
in the same ways they instruct, we separated teaching initiaUy into two constructs, management style and 
instructional style. Management style captures teachers' strategies for mdding students' gemt^^ral 
behavior. It is composed of Tive classroom characteristics: (a) the amount of time teachers allocated 
to reading or sdence instruction; (b) their general praise statements to i&dividual students; (c) their 
general praise statements to groups of students, such as, "Everyone is working very niceiy"; (d) their 
critical statements directed to indwidual students, such n "Johnny, sit down and start to work now"; and 
(e) their critical statements directed to groups (k students. 

5. InstrnctioRal style This is the second construct representing teaching. The variables of the 
instructional style construct are extensions of characteristia reported in research on general teaching 
effectiveness in other areas of elementary education such as reiKling and math that have demonstrated 
the effects that instruction can produce in these areas. Six additional classroom process variables 
compose this construct Half of these variables are measures of the kinds of interactions teachers 

' initiated with indwidual studentt or entire classes. The remaimng half of these variables captuic 
teachen' respcoses to students who have made errors or who can not come up with an answer. 
Instructional style was also characterized by the kinds of feedback-sustained, temunating, or confirming 
-that teachers give. 

6. Hone support for science kn<mlcdce or reading eomprehcBsloa dcvdopaicnt This coostnia 
contains three clusters of variables for science knowledge development: (a) a child's invob/ement in 
sdence processes with parents, (b) the frequency with which parents provide activities for their children, 
and (c) the prevalence of science-related books and magazines m the home to which the child has direct 
access. It contams up to five clusters of variables for reading comprehensioa development: (a) the 
amount the child is read to, (b) the amount the child reads, (c) resources parenU' provide, (d) the 
frequency with which parents provide acthitiei for their children, and (e) the prevalence of all kinds of 
boob and magayines in the home. 

7. IndependcBl reading. This construct represents reading initiated by the child. We anticipated that 
activities such u independent reading might influence children's reading comprehension development 
and sdence knowledge in later grades, but probably not in the kindergarten through second-grade years. 

8. Ability,!. This construct represents students' reading ability or science knowledge in the spring of 
each school year. 

How the Henristic Model Has Been Actualized 

Figure 2 shows annual data collection efforto for the model Our goal has been to administer a battery 
of instruments twice each year to reflect changes in children's reading comprehension development and 
science concept and process acquisition. Most of these measures were adnunisteredbdividually during 
the children's kindergarten through second-grade years. Some individual assessment is antidpated to 
continue for the duration (A the study. 

For analyses focusing on a single year, first or second grade for eample, each fa!^ can be considered 
a new Tune 0. On the other hand, for analyses that occur over several years, the fall fintt-grade test 
scores represent the third wave of daU collection for individual students, the spring first grade as the 
fourth wave, and so on. At both fall and spring each year, multiple measures, norm-referenced and 
ariterion-refereoced, are a dminister ed either to individuals or groups as appropriate. Many of these are 
measr^res that were either developed for this study or were developed by others and then modified on 
thf basis of previous research findings. 



[bucrt Figure 2 about here.] 
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Ability, 0. Thu$ far, many measures of student ability have been administered each fall and again in the 
spring. The decoding subtest of the Wide Range Achievement Test (WRAT) (Jastak, Bijou, Sc. Jastak, 
1965) is one of these instruments. It has been administered each fall to each child since the first weeic 
in kindergarten. Other fall measures include a test of the children's knowledge of environmental print, 
tistening comprehension, passage reading comprehension, and metacognition as measured on various 
error detection instruments. 

OasarooB ■uwagment Oassroom management characTeristici heve been derived from nine fuU-day 
observations of each teacher. The«s obcervations are also audiotaped. For this construct, the 
observational data include time in activities, teachers' overall grouping patterns to deliver instrttst'.on, 
and then' praise and correcthv statements to individuals or groups of children. 

InstractkNul BMterials. Reading and sdenoe textbooks are analyzed each year to reveal most simply 
what the content is. For example, analyses of the science textbooks include the number of specific 
content domains and the vocabulary they present for students to learn. We also study the activities 
teachers are to present Furthermore, in sdeace textbooks, we study the ratio of lecture/discussion 
activities to hamb^ actwities, how many times teachers are to demonstrate experiments, and how often 
stttdms are to complete experiments on their own. Finally, we study bow 'considerate' the text children 
read is. These are quantitathie measures of text characteristics of instructional progranu that others, 
Anderson and Armbruster (1964), for example, have determined afifect students' abilities to comprehend 
whal they read. For all of these materials' characteristics, we have analyzed every page of all science 
materials used in the districts participating in this study. 

Teachers in District A used the MerriU (Sund, Adams, & Hackett, 1980) Accent on Science series. 
District R adopted Holt Science (Abruscato, Forsaceca, Hassard, & Peck, 1980), after using the McGraw 
Hin (Holmes, Leake, & Shaw, 1974) materials. District C teachers implemented Siher Burdett Science 
(Mallinson, Mallinson, SmaUwood, &, Valentino, 1965). 

We analyzed the reading cuUerials to learn about their contents, pedagogy, and the comprehensibility 
of their stories. In addition, we tracked the amount of content indhridtMd chikh«Q covered. Teachers 
in District A used the Hou^on Mifflin (D'lrr, LePere, Alnn, Burryoo, A Shaw, 1979) reading series, 
whereas those in District B used the Harcourt Brace Jovanovich (Early, Cooper, & Santeusanio, 1983a, 
1963b) series. Teachers ia District C used Ginn's 1976 edition (Oymer, Wong, A. Benedict) as their 
main reading program for all students. They provided additional instruction for their low-stanine 
children m the Distar Reading Mastery materials (Engehnann & Bruner, 1983) published by Science 
Research Aasodates (SRA). 

laslrnctioDnl style The data on instruction comes from the nine full da^ of classroom observations 
of each teacher, with the exception of the Cohort 2 second-grade teachers, who were observed seven 
times. These data have been coded to address the four major areas of instructional characteristics 
depicted b Figure 2. E»ch instructional inte r action a teacher initiates was coded, with the codes 
reflecting the tasks the inten.>ctions actually call upon the children to perform. For example, if a teacher 
sayi, 'Open your workbooks to page 7V the children are simply to complete the procedure. If; on the 
other hand, a teacher says, "Everyone read aloud the words oo page 71,' the chiklren are then to 
perform a series of word-rrading tasks. The miyor categories into which interactions fell are (a) 
procedural; (b) text-tied comprehensiott; (c) scriptal; (d) decoding; (e) word, sentence, or paragraph 
reading; or (f) inferential reasoning. Text-tied interactions require studenu to gh« an answer found in 
the text they have read (Pearson & Johnson, 1978). These questions may be answered either ejplidtly 
orimplidtlyinthetext Scriptal (or background knowledge) questions have students answer from what 
they already know about a topic. In addition, teachers give studenu turns m oral or silent reading. 
Ruthennore, especially in science mstruction, teachers often ask studenu to formulate hypotheses, ma^ 
observations regarding manipulated materials, ^ppiy a concept, or predict an outcome. Each interaction 
was also coded as to whether the teacher directed it to the whole class, a small group, or an individual 
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diild Each bdividual and group was numbered so that analyses could focus on the type or frequency 
of interactions occurring at various levels (child, group, or entire class). 

Feedback was coded first into 14 categories that were then collapsed generally into three major types 
similar to those developed by Anderson, Evertson, and Brophy (1979): Feedback m which a teacher 
sustains an interaction with a student by leading or giving a hint; feedback that terminates an interaction 
by calling on another chikl or ignoring the first student's mistake altogether, or feedback that simply 
confirms the student's response. 

Ability, 1. Student ability measures for spring were chosen to reflect changes in students' development 
during the year. For example, we have administered the Error Detection Test (Meyer, Hastings, Linn, 
A Greer, 1965) to studenu since their kindergarten year. In addition, we have developed our own 
science measures for usi; at the end of seoood and third grades to reflect the content we expect students 
to have covered on the basis of our ai\alyses of their textbooks during those grades. In addition, we 
have administered some measures such as the WRAT decoding subtest and the Woodcock Reading 
Mastery Testt comprehension passages (Woodcock, 1973) at least once a year (and often twice a year) 
since the beginning of the stuify. 

IndepcndcBt reading. We have attempted to asiess students' emerging interests in various topics as well 
as the amount of their independent reading beginning in third grade. These procedures and results will 
be reported m depth with the third- through sixth-grade findings and will therefore be described only 
briefty here as part of the complete heuristic model Each third grader has a notebook for recording 
the title and author of each book read. The studenU also indicate whether they actually read the book. 
If they finished the book, they also write briefly about how much they liked it In addition, thty write 
a short phrase or statement on what the book was about The form concludes by having the students 

comfrfete this phrase, 1 want to learn more about At some point during each round of 

observations, we also record the books each third-grade student has currently checked out of the school 
library. This serves as an additional measure of mdependent reading. 

Home Influences. Home influences have been surveyed each spring with separate questionnaires sent 
to parents asking about their general support for literacy-related activities. These questionnaires focus 
on activities such as reading to children and the frequency of trips to the library. A second 
quM tionn ai r e is more directed to science development It focuses on such things as subscriptions to 
science m ag arinrt , The return rate for these questionnaires has always been above 84%. It approached 
90% as the Cohort 1 children completed third grade and has remained at that point Some of these 
influences are Upped with direct questions such as the number of hours of TV that children watch each 
day, while other constructs are measured by giving the parents a paragraph describing a process-oriented 
scens, such as cooking with their children, and asking them to respond to a number of statements as 
if they were in that setting. 

The Setting 

Five school districts were asiced to make six-year commitments to participate in this research. Each 
district was chosen for several reasons. Fust, we were interested in districts with reputations for fairly 
stable student pq>ulations. Second, we wanted districts with reputations for overall high student 
achievement Third, when possible, we wanted to work with all children at the appropriate grade levels 
in the district, thereby reducing the potential for problems from attrition as families move within their 
communities. Fourth, we wanted school districts that were reasonably dose to our university 
community. Fifth, we needed districts that wouU grant permission at the school or superintendent level 
to allow a study of this duration so that we could guarantee that all teachers would participate. Three 
districts agreed to p^vtidpate fiilly. 
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DUtrkt A. District A has a reputation for high student performance in reading and average 
performance in science. This is a farming/smaU'lown conununity that is somewhat isolated. It has one 
elementary school There are approximately 80 children per coliort in this Mtting^ and all children in 
the district at the designated grade levels participate in ^he study. 

District B. District B hv a reputation for average student performarice in readmg and average 
performance io science. This is a "commuter" district for many families, who travel about 20 minutes 
to work. AU children m the district at the appropriate grade leveU participate in this study. There are 
approximately 150 children m each cohort in District B. They attend one grade school. 

DUtrkt C. District C is often described as a "microcotm of the universe." Ilie district has the racial 
and ethnic mixture of many umer<ity schools, yet its studempopulat/ion Thedistric^ 
has a reputation for high student performance m reading. One eilementary schod from the district 
participates in this study. There are about 80 children per cohort, 

PIloC scfaooL One school from a fourth district also participates in this study as our designated pilot 
school Each year, all of the new measures are piloted in this school and then subsequently revised. 
The student performance in this school tends to be just about normally distributed, and there is a multi- 
ethnic student population. About SO students and parenu at the same grade level as Cohort 1 children 
participate in the study from this school 

There were no s^nificant differences m student performance between these districts on the decoding 
subtest of the WRAT as students entered kindergarten (Linn & Meyer, 198S). 

Selected Questioas 

This section presents interesting questions and surprising findings from our study. The results are 
surprising either because they contradict the work of other researchers or because they are counter 
intuitwe. These results, presented by grade level* are from analyses completed on two cohorts of 
children, approximately 625 students, assigned to atraut 40 teachers. 

Questions Emerging from Kindergarten Findings 

t Are catering abUity and teacher behavior better predictor? of student acUcvc«cat than Is length 
«f sdiool day? In our sample, two districts have half-day kindergarten classes and one district has 
whole-day classes. One would expect whole-day kindergarten programs to yield higher student 
achievenientthaahalf-<'a/progranu because of the greater opportunities for mstruction. Severalstv 
(Jarvis & Motnar, 1983; Johnson, 1974; Oliver. 1980; Winter & Klein, 1970) have debated the merits of 
whole-day versus half-day programs without studymg the academic eifects. Surprisingly, we found that 
children in whole-day classes did not have higher student achievement at the end of kindergarten than 
the children in half-day programs. In fact, on average, students who had been in the vtiiole-day 
programs were the lowest performers on several measures of achievement 

Of an instnjments we administered, including measures of environmental print, word recognition, 
listening comprehension, oral language ability, and gewal sdeace knowlnlgB, we w^ 
for the Chica^ Reading Test (Barr, 1963) because m a test of letter sounds, word endings, word 
families, and random words, it proved most sensitive to differences in mstructional emphasis in 
kindergarten programs. In a set of regression analyses, the classroom process variaUes that were 
associated sig nifi ca ntly with performance on the Chicago were total teacher-directed mteractions 
(decoding and comprehension); sustained feedback, procedures teachers use to maintain mtenctions 
with a child who has made an error until she or he can produce a correct response; and time spent in 
reading mstroction. These variables represent characteristia that collectively suggest that the more 
b u si n e s sl ik e, structured kindergarten environment results in higher student achievement f n reading at 
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that grade level (Meyer, Hastings, Wardrop, & Una, 1988). Therefore, length of school day failed to 
predict student achievement whereas numerous teacher behaviors and entering ability were predictors 
of achievement 

2. Do klndei|Mt» cUidrea cxSilM^ netacofBitlvc abUlty? It is commonly believed (Markman, 1977, 
1979) that duldren develop the ability to monitor their own compreiwusion during adolescence. The 
highest performing children at the end of kindergarten (those children who were actually reading), 
performed well oo "mctacognitwe" (error detection) silent reading tasks. Evidence of these 6-year-olds' 
ability to monitor their com{mbensioo was dear on instructional tasks even before the spring of their 
kindergarten year. For this reason, children who scored 10 or above on the Woodcock reading 
GomprAhension passages subtest also received the Weber Comprehension Test (Weber, 1971), an 
instrument actually desigiKxl for use with inner<ity diiUren at the end of tl^ 

comprehension. To complete the tasks on this test correctly, studenU had to select a word that "spoiled 
the meanittgT from a passage composed of up to three short sentences. Endnrf-kindergarten high 
performers could not only perform these tasks, but they often laughed and made comments about the 
passages, thereby giving clear evidence that thef understood what they were reading (Meyer, Hastings, 
Linn, A Greer, 1985). These surprising findhags suggest that metacognitive ability may develop in 
tandem with word*recognition and word-meaning ability. 

3. Are teaching behaviors witUn districts stable? One might expect great individual differences among 
teachers in the same school districts. We found, however, that the behaviors of teachers in District A 
tended to bs more similar to each other than to the behaviors of teachers in Districts B or C. Teachers' 
instructional characteristics within districts were very similar when charting their time or frequencies of 
interactions within literacy*related or science activities. These results were stable from morning to 
afterficco for teachers who Uught half-day dass^ (Linn & Meyer, 198S; Meyer, Linn, & Hasting 
196Sa; Meyer, Linn, & Hastings, in press). 

4. An ladlvldnal teachers' behaviors stable over tlnsc? Previous research oe teacher stability (Brophy, 
1972; Rogosa, Floden, & Willett, 1964; Rosenshine, 1970; Shavelson & Deiripsy-Atwood, 1976) suggests 
that teachers' behaviors are quite unstable. However, we found teachers' tune in reading and their 
frequencies of interactions during reading instruction vnn very stable from morning to afternoon and 
from year to year (Meyer, Linn, & Hastings, in press). Figures 3, 4, and S illustrate thesu results. 

[Insert Flgon; 3 about here.] 

Figure 3 shows ploU of two kindergarten teachers from District A. The X axis represents nine rounds 
of full-day observations while the Y axis shows minutes spent in decoding during each round Despite 
variance from round to round, the teachers are very stable in the time allocated to decoding when 
comparing their morning and afternoon classes. 

Figure 4 shows the District B teachers on thae same measures. 

[Insert Figure 4 about here.] 

Comparable results of stabiUty are found when {dotting the frequency of these same teachers' 
interactions. Figure 5 shows these tallies for the District A teachers. 

[Insert Figure 5 about here.] 

This figure shows the number of times each teacher pmcnted an instructionai interaction coded as 
decodi n g during each of the same nine rounds shown in the two previous figures with their mora;jip, and 
afternoon classes. 
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We believe that these data show dramatically that the teachers' behaviors were quite stable when 
observed with two different classes on the same days. This finding seems to contradict the earlier 
conclusions of Shavelson and Dempsey-Atwood (1976), Rosenshine (1970), and others such as Brophy 
(1972) and Rogosa et aL (1964), who reported teacher behaviors to be quite unstable. As can be seen 
in the figures, there is considerable variability for any given teacher from one round of observations to 
another, but on a given day, Ibe scores for a single teacher with two different classes are quite 
comparable. Thii suggests that day-to-day fluctuations may well be planned and not simpSy random 
variation. 

To the degree that variations over time reflect intentional changes in instruction, it seems more 
appropriate to study teachers at comparable pobu in their currii»la with different classes than it is to 
compare differences m teachers between observational rounds. The study of idndergarten teachers 
afforded a unique opportunity to address this question because all but three of the teachers Uught half- 
day classes each day (Meyer, Hasting^ Wardrop, A Unn, 1968; Meyer, Linn, & Hastiness, 198Sa; Meyer, 
Linn, & Hastings, 198Sb). Comparisons of whole-day teachers over years with two cohorts of childrea 
also yielded similar results for teacher stalHlity. 

This evidence of teacher stability is particularly Important because researchers have ofltcn used 
observational data to try to explain differences in student performance, and the reliability and validity 
of these findings rest upon the assumption that teachers' behaviors are stable and therefore predictable. 
Given the appnrently deliberate changes that teachers appear to make in their instructional routines over 
time, it may be important to obtain several observations at different intervals during the school year. 
In adiition, full-day observations may be particularly important when studying the lower elementary 
grades because most lessons last for shoit periods of time. 

5. Does wholc<iass Instmction produce Ugbcr student acUcvancat la reading than docs iastmctlon 
lap^pi? Teachers typically dwide studenU into three or more groups to teach reading. Therefore, 
there is a very strong tradition to support the existence of reading groups. Whole-class instruction in 
reading, on the other hand, is virtually unheard of . Therefore, it was very surprising to find whole-class 
reading instruction in one of our districts. It was startling to see the results of this instruction. Wholc- 
dass instruction in reading with teachers' interactions focused on thrrr lowest performers produced the 
greatest differeixes in achievement between classes and the least vark within cl^ 
1965; Meyer, Hastings, Wardrop, A Linn, 1968: Meyer, Linn, & Hastirc, 196Sa). District A teachers 
presented their initial reading instruction in the Alpha K Tim (Reiss & Friedman, 1976) program to 
whole classes. Teachers m District B grouped for instruction in Harcourt Brace Jovanovich's Look, 
Listen, and Learn (Early et aL, 19S3a) and in Sounds, Symbots and Sense (Early et aL, 1963b). !n 
contrast. District C teachers taught more informally throughout their school days. In these dasser*, 
instruction was often delivered to individual children or small groups that self-selected t(> work with their 
teachen on language experience stories or similar activities. The overall highest achievement gains 
across measures were found in District A (Meyer, Hastings, Wardrop, & Linn, 1988). 

Questions Emerging from First-Grade Findings 

L Docs whole-class UntrvctloacoBtinnc to prodncc the higbcst student achl^^ 
grade? Were the results and patterns ofwhole-class instruction in kindergarten an aberration? Reading 
groups are the norm for reading instruction in American first grades. What would the results of whole- 
class instruction in reading kwk like m first grade? District A first-grade teachers delivered instruct'^ 
in reading to entire classes jivt as their kindergarten colleagues had. This district's policy is to teach 
to entire dasies since all studenU are expected to "coK^ the same content. Teachers occasionally work 
with a few k)wer performing studenU grouped with some high-performing students, but diese grou 
are temporary. In Uwse situadoas, group membership changes often so duu students do not rudily 
idendfy as members of a kwer performing group (Meyer, Linn, & Hasdngi, 1987). District A students 
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continued to outperform children from the other two districts on various reading measures at the end 
of first grade. 

2. Wlint is the rdatioaship bctwtca the ftfanc teachers spend mding to their students and the time 
spead teaehlof reading? It has been recooimended by diverse groups of reading researchers and 
specialists that teachers spend regular classroom time reading to students (e^ Feitelsoa, Kita, & 
Goldstein, 1966; Hewison & Tizard, 1980). This is a time-honored, ahnost sacred, tradition. However, 
we found that teachers' reading to students was negatively associated with student achievement m 
reading, just as it had been in kindergarten. All other large process-product studies (Brophy & 
Evertson, 1976; Stallings, Cory, Fairweather, & Needles, 1977; Stallings & Kaslunvitz, 1974) have also 
found this negative relationship between teachers' reading and student achievement, despite consistently 
favorable results in intervention studies for reading to children (e^., Andek-son, R^rt, Scott, & 
Wilkinson, 1985; FeUelson et al, 1986; Hewiscn & Tizard, 1980, McCormick & Mason, 1986; Tizard, 
Schofield, & Hewison, 1982). Within the context of this longitudinal study we hope to explain these 
counter-intuitive and puzzling findings. 

Table 1 shows results from full-day observations of 42 kindergarten and first-grade classes. This table 
shows the average time (in minutes) these teachers spent in reading instruction, their total time in all 
instruction minus adult reading, and their story reading and decoding minutes. Tmie in this table 
represents the average minutes in each activity from the nine full days of observation each year by 
district 

Of most mterest in Table 1 are the comparisons of minutes in reading instruction and m story reading. 
District A teachers (these are the teachers that have produced the overall highest reading performance) 
average roughly 35-40 minutes of reading instruction in kindergarten and over 40 minutes per day of 
reading instruction in their first-grade classes. District B and District C teachen are much more similar 
to each other and quite different from District A teachers at the kindergarten level Each of these 
districts has only 7-8 minutes (District B) or just over 5 minutes (District C) of reading instruction per 
day in kindergarten. In both districts, reading instruction time increases greatly in first grade, however. 
It is important to keep in mind that District A teachers deliver their instruction to whole classes while 
District B and District C teachers divide students homogeneously into small groups for instruction. 
Therefore, even in first grade. District A students actually receive much more instructional time 
delivered by their teachers than do students in either District B or District C (Mever, Linn, & Hastinas. 
1986). ' 

[Insert Table 1 about here.] 

Tune spent in story reading in these three districts presents an interesting contrast to time spent in 
reading instruction. District C teachers spend the most time reading stories to their classes in 
kindergarten, ahnost four tunes the number of minutes that they spend in reading instruction. The 
pattern between districts is quite di£ferent for the first grades. District C first-grade teachers spend the 
least amount of time reading stories and District B teachers average the most minutes in this activity. 

1 hese findings allow us to make a rather simple statement to explain why kindergarten teachers' reading 
to students correlates negatively with those students' reading achievement It seenu that in naturalistic 
settings, reading to students may be thought of as an alternative to activities that result in more direct 
instruction in reading. It is fairly clear that teachers make choices about how they spend their time. 
As readmg instructional time goes up in these districts, story reading time usually goes down. What 
remains to be seen m this lon^tudinal study is if time teachers spent reading at the kindergarten level 
pays off later in children's vocabulary growth or overall reading comprehension in later grades. 

3. Docs eonprehciiiioa BMmitorittg ability coBtiniie to develop? Developmental reading rese&rchers 
(Markman, 1977, 1979) have assumed that children develop the ability to monitor their comprehension 
as they become adolescents. Contrary to these belief^ we found some evidence that high-performing 
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children could monitor their comprehension in kindergarten. How would all of the first graders perform 
on an instrument measuring their cognitive ability? b metacognitive ability at this grade level limited 
to the highest performances? The kindergarten results on the Weber led to the development of our 
Error Detection Test (Meyer, Hastings, Unn, & Greer, 1985) to use with all children in this study at 
the end of their first-grade year. This instrument was developed from reading vocabulary that had 
appeared in the reading or science progranu that all children had been taught. The first subtest, Absurd 
Target Words, is similar m construction to the Weber because each item was developed from several 
short sentences. Students were to identify a word that "spoiled the meaning." In the second subtest, 
Iiupossible Sequence, students had to identify what happened at the wrong time. Here, students read 
aloud to an examiner and the examiner corre^ed the students' oral readmg errors. In addition, children 
were asked to support their answers. K *st graders were dearly able to identify both absurd target words 
and impossible sequences and support their answers. They averaged getting 9 out of 10 absurd target 
words corr^'ct and 4 out of the 6 impossibk! sequences, lliis instrument and the other new measures 
developed for use in this study are described with their results m Meyer, Hastings, and Linn (1988). 

4. Do at-risk stadcnU nscehrc dlffct'CBt Instnictioa than do students who are not at risk? Lore 
strong siuggests that Chapter 1 work with students begins rither uniformly in first grade. We found, 
however, quite different procedures and philosophies in the three districts. In first grade, the three 
districts began very different treatments for children at risk. In District A, for example, classroom 
teachen took most of the responsibility for reading instruction for their first graders. Once again, the 
district philosophy seemed to be that eveiy child is to cover the district reading curriculum, so teachers 
set about teaching in ways to accomplish this goal While teachmg entire classes, these teachers focused 
on k>wer performers by giving them large numbers of individual turns and sustained feedback. These 
strate^ allowed the lower performers to maintain the pace of the other students m the class. These 
teachers also gave large numbers of group (whote-dass) turns. Students in District A chosen to receive 
special services were primarily those ^o were fairly dearly targeted for special education or children 
already repeating first grade. 

In District B, classroom teachers also assumed most of the responsibility for reading instruction for all 
itudents in first grade. These teachers formed up to four reading groups to teach reading, just as the 
kindergarten teachers in this satae district had done. Therefore, this district's grouping policies present 
a dramatic contrast to the whole-class instruction practices in District A. As in District A, few children 
b first grade in District B receded any type of special services. 

In District C, children designated as the "low-stanine" children on the basis of their kindergarten 
achievement test scores received special reading instruction from a teacher designated to teach those 
(Chapter 1) children from the onset of first grade. In this setting, the first graders who received help 
from the special teacher were also designated the "intensive readers." This meant that these students 
received reading instruction from both the low-stanine group teacher and their regular classroom 
teacher. The reading materials were quite different in these two instructional settings. SRA Distar 
Reading Mastery (Engetmann & Bruner, 1983) was used by the Chapter 1 teacher, and Ginn 720 
(Clymer et aL, 1976) was used in the regular classroom. The combined effectiveness of these programs 
for students at risk remains to be seen. Chen's (1990) study of the pooled results of these efforts 
revealed that by the end of second grade, successful remediation had been accomplished. 

Questions Emerging flpom Second-Grade Findings 

1. Are flmt- and second-frade basals alike? Basal reading jmjgrams are typically analyzed by looking 
at several publishers at the same grade levels (Beck A McCaslin, 1978; Chall, 1967) or by studying a 
variety of progranu to find specific examples of activities (Osbom, 1981). Littlev if any work has been 
done on the continuity within series, and no one has previously studied stories within series in a 
systematic way. Therefore, y^]c series typically get labeled "meaning emphasis" or "word recognition 
emphasis." Are these labels appropriate? Is there continuity from one level of a series to another? The 



Meyer 



When in the Course of a Longitudinal Study • 12 



contents and characteristics of the basal readers used in the three districts vary substantially. As 
mentioned in the description of the heuristic model, the systematic analysis of textbooks is an important 
part of our longitudinal study. Just as classroom obcemtions provide information on how teachers 
present information to students, materials analysis results depict what students have actually covered and 
the quality of the text they read during instruction. Analyses of the second*grade basals used in the 
three dis^cts revealed substantial differences between instructional programs. These results are 
summarized in Tables 2 and 3 and reported fully m Mcy^r, Greer, Crummey, and Boyer (in press). 

(Insert Tables 2 and 3 abottt here.] 

These analyses focused on the frequency of decoding and comprehension activities in the materials, the 
number of reading vocabulary words presented, and a measure of 'considerateness" of text for selected 
matched and unma t ched stories. The tallies for decoding and comprehension activities are simple counts 
of directives teachers are to give from every page of the teachers' guidos. Words in connected text are 
the total number (tf words students read from their materials. 

Story considerateness was measured by applying Beck, McKeown, Omanson, and Pople's (1984) 
procedures developed to modify a second-grade basal story for an ejqwrimental study to measure 
students' abilities to comprehend original basal and revised (more considerate) text. A summary of 
these results appears m Table 4. While words per incoherence and thought units per mcoherence are 
not accurate representations of how the incoherences would be distributed throughout a story, they do 
give a sense of how frequently incoherences occur. We believe that it iii this sense of the density of 
inoAerences that is an important issue in beginning reading programs. 

[Insert Table 4 about here.] 

If the matched stories m each category are taken as a group, the stories that present a dilemma are the 
most comprehensible, the expository text stories the next most comprehensible, and the personification 
stories the least comprehensible stories m the four series. The comparisons between publishers for 
matched and unmatched stories reveal that the matched Ginn stories are the most comprehensible, 
followed fairly closely by the SRA Distar Reading Mastery stories. The Houghton Mifflm (Durr et aL, 
1979) stories place third, and the Harcourt Brace Jovanovich stories were found to be the least 
comprehensible. For unmatched stories, the SRA Distar Reading Mastery stories were the most 
comprehensible, followed by Houghton Mifflin, Ginn, and Harcourt Brace Jovanovich. 

2. Does teaching mediate students' sdcncc perfonaance oa criterioa-refcreiiced measures? Prior to 
this study, there has been no long'term, systematic research on the effects of teaching on children's 
achievement in science. The pervasive belief is that children learn science best by doing hands-on 
activities (Bredderman, 1983) with little teacher direction or textbook emphasis. Therefore, despite our 
desire to develop tests sensitive to the content of the textbooks used in the schools participating m this 
study, we anticipated that performance on these instruments might not be mediated by the teaching 
observed in the classrooms. Nonetheless, we developed three group-administered science tests for 
second graders (Hastings, Meyer, & Linn, 1987). The content of these three tests was drawn from the 
common content domains identified m the basal science textbooks (Meyer, Crummey, & Greer, 1988) 
used by the three districts. Plants is a content domain about which school-age students probably have 
background Imowledge and then learn additional information in school over several years. In the 
content domain Three Forms of Matter, second graders may have some background knowledge, but the 
domain has not yet been formally introduced in school We also developed items for Motion as a 
content domain because there is a great deal of evidence (Nickerson, 198S) that students misunderstand 
the basic concepts of motion and because this domain has not been formally introduced in science 
textboob at the second-grade level This domain is not introduced until at least fourth grade in 
textbooks used in any of the districts participating in this study. All of these criterion-referenced tests 
were read to students. 
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The most interesting aspect of the results from these three tests and from the Sequential Test of 
Educational Progress (STEP) (Educational Testing Service, 1979) test of general science knowledge is 
that District B students consistently achieve the highest scores. This is the district in which teachers 
allocate the most time to science instruction with the greatest number of interactions and feedback to 
students (Linn, Meyer, & Hastings, 1987)* Subsequently, they cover more science content than teachers 
in the other two d^cts. 

(Insert Table 5 about here.] 

Results of regression analyses that began with classroom process variables revealed that text-tied 
interactions and sustained feedback produced ^gpiifif^nf changes in students' achievtment on Plants 
test (Meyer, Hastings, & Wardrop, 1988). These results are particularh^ encouraging because they 
illustrate that teachers' mstr^ctional practices can have effects on students' achievement in science, even 
in the lower elementary grades. 

A two-factor analysis on the three criterion^referenced tests, two norm-referenced science tests, and two 
norm-referenced reading tests was performed. All of the criterion-referenced instruments and the Tests 
of Basic Experience (TOBE 2) (CTB/McGraw-Hill, 1978), a test of general science knowledge 
administered in the spring of kindergarten, k>aded on the first factor. The STEP and various reading 
instruments loaded on the second factor (Hastings, Meyer, St Linn, 1987), suggesting that the first factor 
may represent science concept knovrfedge while the second factor represents general ability. These 
results are particularly encouraging because they were achieved with 7-year-olds. They suggest that 
similar, and perhaps even more powerful results may be found with older students who receive more 
science instruction. 

3« Are science textbooks "considerate" to students? Work by Anderson and Armbruster (1984) asserts 
that content area textbooks used m elementary schools today are "inconsiderate** to students because 
they are poorly written and illustrated Therefore, we were quite surprised tr find generally opposite 
results as well as substantial variance between science textbook series when we completed a quantitative 
analysis of several programs. Inanalyringthesematerials,ourprimayy questions were "What ism these 
booksr, "How is the content presentedr, and "How considerate is the text?" (see Meyer, Crummey, & 
Greer, 1988, (of the comprehensive results of this work). 

While the Holt (Abruscato et aL, 1980), McGraw-Hill (Hohnes et aL, 1974), and SiKer Burdett 
(Mallinson et aL, 1985) programs unplcmented at different times m District B were found to differ 
substantially in the number of vocabulary words and the number of content domams presented each 
year, they are surprisingly alike in their overall considerateness. We used the Anderson and Armbruster 
(1984) categories formulated for assessing considerate text We organized their categories under the 
hc > ading s of structure, content, or pictures and diagrams for this anJysis. We compared common 
content domains at comparable grade levels using detailed definitions for each of the 10 categories. As 
Tables 6 and 7 illustrate, we found very few examples of the failings that Anderson and Armbruster 
assert characterize elementary school expository text 

These results are from reading every word and k)oking at every picture and diagram in six content 
domains (27 chapters) in five grade levels, published by four different major science textbook publishers. 
In Table 6, 44 of the 80 entries (55%) in the categories are zeros. The largest numbers of problems 
found m the texts fall clearly under the headings of incomplete background knowledge or pictures and 
diagrams. Table 7 shows results for the content domains of the human body, plants, the solar system, 
andweather. In this table, 89 of the 190 entries, or about 47% of the categories, are agak The 
largest numbers of inconsiderate text examples fall once again under the incomplete background 
knowledge and hard to see or unclear pictures categories. We question the Anderson and Armbruster 
(1984) suggestion that all unlabeled pictures or diagnuns should be counted as inconsiderate because 
many of the texts' pictures and diagrams in these series seemed clear and therefore without real need 
of lai)els. 
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[Insert Tanks 6 and 7 about here.] 

4. How do students In whole<class reading lastmctiou compare to students in traditional classrooms? 
We continued to be surprised to find whole*clas8 reading instruction at the second-grade level in one 
school, and we were particularly surprised to see how children from these classes compared in reading 
achievement to students from classrooms where teachers taught reading in groups. Data collected with 
multiple measures, group and individually adounistered tests d reading comprehension, show district 
performance Eiirly consistent with the kindergartea and first-grade results at the second-grade level 
District A continued to have the highest student performance in reading, District B placed second, and 
District C held third place on three measures of leading, the WRAT, the CIRCUS Reading 
(Educational Testing Service, 1976), and the Error Detection Test The instruments on which district 
performance shifted were the Degrees of Reading Power (DRP) (CoU^ Board, 1979) test, the 
Woodcock, Eugene (Engelmann & Meyer, 1974), and the Weber. On these instruments. District B 
students performed slightly higher than Distkict A students. Second-grade District C students were 
consistently in third place except for their performance on the DRP where they were in second place. 

These results are particularly interesting because they suggest that while there may be continuing 
positive effects from District A's kindergarten reading program and/or those teachers' whole-class 
reading instruction from kindergarten through seomd grade for decoding, other factors may be 
influendrg comprehension development Further analyses will address these questions to determine 
what mediated the children's achievement in each area of development at these grade levels. 

5. Do parents from dllTerent school dlstricU respond consistently to sdencc qucstlonnaln Items? As 
described earlier, three districts participated in this study. The districts were in part selected because 
they reivesent several different types of communities, and consequently, public school settings. 
Therefore, one would anticipate that those differences m^ be reflected m parents' responses on the 
ques ti onnai r es we gave them. However, indices developed to analyze responses Lorn the science 
questionnaires administered to parents at kindergarten, first-, and second-grade levels reveal minor 
differences between districts (Meyer, Linn, & Hastings, 1987). These resulu hold for the prx>cess 
invohement parents report having with their children, the number of experiences they provide for their 
children, and the books and other resources they provide that may be related to children's achievement 
in sdence. These results are particularly uteresting given the rather diverse settings that the three 
districts rei»resent. Future analyses will examine the relative impact of classroom instruction, science 
textbooks, and home influences on children's science concept acquisition and process knowledge. 

Questions for Future Research 

None of the areas of research suggested by our questions was part of the specific questions guiding our 
l o n gi tu di n a l study, yet each of them has provided an area to investigate that has resulted in findings that 
are unportant in themsehfes. They provide support for the importance of research that takes place in 
naturalistic settings where researchers begin with very general questions such as "How are these 
textbooks similarr or "How do the metl^ of teaching reading in the lower elementary grades differ, 
and which method produces the best resultsr This open-cvided process led to findi&gs that might simply 
have been overlooked if the methods had been different 

While we consider these 14 findings among the most interesting preliminary results from the first four 
years of our longitudinal investigation of children's reading comprehension development and science 
concept acquisition, many more analyses are needed to determine how these results are related. Causal 
models will illustrate how these outcomes work together to compose a model of how students learned 
to comprehend V)Hbat they read and how they tearned science content In addition, there are many other 
questions that we believe can be addressed with this data base. The questions that follow are among 
those we espcfX to tKfkxt over the next few years. 



17 



Meyer 



When in the Course of a Longitudinal Study - IS 



t Do teachers teach children of different ability differently when they are at comparable points in 
a curriculum? 

1 What are the short* and long-term effects of different special education treatments? 

3. Can we identify a hierarchy of instructional interactions that produce the most effective results in 
reading/science? 

4. How does reading instruction in special classroom settings compare with reading instruction taking 
place at the same time m regular classrooms? In other words, what are students in special classes 
getting or missing when they are away from their regular classrooms? 

5. Will there be long-term positive effects from teachers* reading to students? 

6. How do young children develop reading interests/background knowledge independently? 

7. What are the long-term effects of (a) a transition room treatment, (b) holding students over in 
kindergarten, or (c) holding students over m first grade? 

3. Are there long-term effects for whole-day versus half-day kindergarten programs? Or, is there 
really another issue? 

9« Is reading rate as unportant for older students when they read expository text as it was when they 
read narrative text in the early grades? 

10. What are the differential effects on achievement of silent versus oral reading? 

IL What is the relationship between kmdergarten children's knowledge of environmental print and 
their later reading comprehension ability? 

12. Are there differences in addition to time spent in reading instruction and reading to students that 
generally characterize classrooms where teachers' reading to students correlates negatively with 
students' achievement in reading? 
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Tablet 

Time foR Reading, Instnictioiial Time Minus Stoiy Reading; and Stoiy Reading Aggregated by Grade Level for 
Kindeiigarten and First-Grade Teachers (N s 42 classes) 

TiiQC Spent in: 

Instruction 
Reading Minus 







Instruction 


Adult Reading 


Stoiy Reading 


Decoding 




Grade Level 


X 


SD 


X 


SD 


X 


SD 


X 


SD 


District A 




















(N mU classes) 


K(Co I) 


40.61 


(5.26) 


17.89 


(1J9) 


5.67 


(1.46) 


122J3 


(7.03) 




K(Co2) 


34.97 


(3.60) 


37.94 


(10.47) 


4.97 


(1.42) 


129.67 


(1034) 




1 


43.80 


(15.41) 


108.50 


(22.00) 


5.89 


(4.56) 


216.03 


(173.28) 


District B 




















(AT « 20 classes) 


K(Co 1) 


151 


(6.62) 


30.79 


(13.54) 


7.02 


(3.10) 


55.87 


(17.58) 




K(Co2) 


6.72 


(2.22) 


38.68 


(4.96) 


5.20 


(3.11) 


82.91 


(19.93) 




1 


38.27 


(5.91) 


109.40 


(14.65) 


12.28 


(4.97) 


254.47 


(66.01) 


District C 




















(N « 10 classes) 


K(Co 1) 


5.18 


(1.99) 


23.78 


(8.64) 


25.56 


(9.63) 


29.89 


(7.58) 




K (Co 2) 


5.22 


(2.22) 


71.44 


(20.93) 


19.70 


(7.21) 


20.04 


(13.00) 




1 


35.20 


(12.47) 


106.59 


(13.57) 


4.45 


(3.53) 


109.30 


(39.29) 



Table 2 

Summaiy of First- and Second-Grade Basal Reader Decoding Instruction and Text Analysis 



Reading Number of: 



Program 



Letter SyUabications/ 
Sounds Naming Endings Rules 



Girni, 1976 

1st Grade 2,641 

2nd Grade 1,502 

Harcourt Brace 
Jovanovi(\ 1983 

1st Grade 1,764 

2nd Grade 3,276 

Houghton Mifflin, 
1979 

1st Grade 1,478 

2nd Grade 3,277 

SRA Distar 
Reading Mastery, 
19S3 

1st Grade 2,655 

2ad Grade 1,339 



346 
169 



670 
444 



808 
664 



4,015 



0 
481 



0 

1,110 



0 
567 



Rhyming Blending 



35 
35 



10 

27 



8 
163 



0 



44 

10 



292 
161 



119 
0 



278 
0 



0 
0 



0 
0 



0 
0 



805 
579 



Vocabulary Words in Words ta 
Words Stories Isolation 



871 

1,311 



425 

678 



607 

676 



1,236 
4,154 



20,982 
104,600 



17,164 
79,867 



12,264 
64,669 



5,919 
67,400 



U34 



2,658 



3,795 



5,702 



24 



Table 3 

Summao' of First- and Second-Grade Basal Reader Comprehension Instruction 



Program 



Ginn,1976 

1st Grade 

2ad Grade 

Harcourt Brace 
Jovanovich, 1983 

1st Grade 

2nd Grade 

Houghton Mifilin, 
1979 

1st Grade 

2nd Grade 

SRA Distar 
Reading Mastery, 
1983 

1st Grade 

2nd Grade 



Word 



Text Explicit Questions 
Sentence Paragraph 



178 
1^22 



216 
855 



120 
274 



155 
38 



751 



536 



977 



531 



1,192 
1,674 



541 



824 



103 



166 



0 

111 



Picture 



109 
34 



232 
114 



425 

250 



25 



0 
384 



Word 



567 
1,951 



494 

506 



851 
445 



0 
2 



Text Implicit Quutions 
Sentence Paragraph Picture 



1,107 
1,341 



494 
1,579 



854 
506 



141 

72 



0 

219 



0 

262 



0 
79 



0 

12 



472 
47 



126 
50 



273 
127 



0 

238 
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Table 4 

Words per Incoherence for Matched and Unmatched First- and Second-Grade Basal 
Stories 



Publisher 



Ginn 



1st Grade 
2nd Grade 



Matched 
X 



27.40 
6120 



Stories 

(SD) 



(18.62) 
(27.63) 



Unmatched 
X 



4938 
49.09 



Stories 
(SD) 



(29.68) 
(19.77) 



Harcourt, Brace, 
Jovanovich 

1st Grade 

2nd Grade 



12.80 
21J0 



(237) 
(8.73) 



27.00 
15.20 



(23.99) 
( 5.09) 



Houghton MifiQia 
1st Grade 
2nd Grade 



78.10 
43.62 



(58.91) 
(25.99) 



118J0 
37.82 



(29.24) 
(12.16) 



SRADistar 
Reading Mastery 

1st Grade 

2nd Grade 



244.50 
57.83 



(4.95) 
(338) 



104.97 
68.27 



(32.99) 
(20.76) 
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Table 5 



Second Graders' Performance in the Content Domains of Plants, Three Forms of 
Matter, Motion, and on the STEP Science Test 



ERIC 



Instnunent District 



(SD) 



Plants Content Domain A (A^ - 78) 20.73 (3 J4) 

Ato of In and Out B (iV - 144) 2L50 (2.88) 

of Level Itenu C (A^ - 83) 21.22 U^i) 
0 • 33 Score Range 



Three Forms of Matter A (A^ - 77) 18.95 (5 09) 

Content Domain Out of B (A^ - 144) 21.27 (4 61) 

l^vd Arca C (AT « 85) 20.02 (6.06) 
0 • 34 Score Range 



Motion Content Domain A(N » 77) 1134 (2 66) 

Out of Level Area B (A^ - 144) (2;io) 

0-20 Score Range C (A^ - 85) 11.62 (2.41) 



Step Science Test A (A^ - 77) 35.86 ^6.13) 

Norm-referenced General B (;V - 143) 3724 (6 93) 

Measure of Science Ability C (A^ - 85) 35.12 (887^ 

0 - 50 Score Range ' ' 
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Table € 



Inconsiderate StnicturaS, Content, and Pictorial Cliaracteristics of Common Content Domains and Grade Levels for tiie 
Holt, McGraw-Hill, Merrill, and Sllver-Burdett Science Programs 



Number of 

SiOiSliUS ffWWm Picture A Diimmt 



Ltvttl DofluiiiA 




lUogical 


or Unclear 


EipiftAtlioiiii 


IntkvMt 


IncoQiplctis 
BackgytMuid 


Probtemalic 
Tccimical 

TPm ■ n 1 ■ 

icnM 


Figunlivc 
1 iiumge 


Pake 

Infomuitiofi 


UnoccciMiy 


Hard to 
See or 
unclear 


1 ANIMALS 


MeniU 


0 


1 


0 


0 


2 


0 


0 


0 


0 


29 




SUvcp 
Bunket 


s 


0 


0 


0 


S 


0 


0 


0 


0 


S4 




MerriU 


2 


0 


0 


1 




0 


0 


1 


0 


27 




Silve^ 
Burden 


0 


0 


0 


i 


14 


2 


0 


0 


0 


12 




MerriU 


0 


6 


0 


3 


28 


s 


1 


0 


8 


73 


4 ELECTRICITY 
A MAGNEnSM 


Holt 


0 


s 


0 


10 


23 


1 


0 


2 


s 


35 




MerriU 


1 


2 


0 


0 


14 


0 


0 


0 


0 


0 




Silver- 
Burdett 


0 


6 


0 


3 


12 


2 


0 


0 


s 


11 



30 



31 



Tabic € (Continued) 



NiuBberof 



















Content 






Pkturet A EMa««m« 


Oiade 
Uvd 


CoatMl 

DOMliH 


PuMMter 


lUogical 
SuuetHre 


LMkof 
Cooaective* 
or llMdear 
Refcrenlt 


lUofical 

PiiplMntlnt, 
or Pnxtdyre* 


Imkvuit 
kkw 


Incomplete 

DackgKMNMl 


ProMcBMlic 
TedMktl 
Term 


Pigurattvc 
L«iiia|e 


Pthc 

InformlkNi 


Hanllo 
Sec or 

Uiwecesury Unclear 




HUMAN BODY 


McrriU 


1 


6 


1 




14 


1 


2 


1 


8 30 






SUvc^ 
Bufdelt 


2 


0 


0 




1 


0 


0 


0 


4 1 






Holt 


0 


0 


0 




3 


1 


0 


1 


10 4 






McGnw-HiU 


3 


3 


0 


• 


S 


0 


0 


0 


4 2 






McrriU 


0 


0 


0 




8 


s 


0 


0 


9 3 






Silve^ 
Bunkit 


0 


1 


0 




S 


0 


0 


1 


S 4 




PLANTS 


McrriU 


5 


8 


0 




6 


0 


0 


1 


2 6 






SUvcr- 
Buidelt 


0 


0 


0 




8 


0 


0 


0 


0 7 






McrriU 


0 


11 


0 




11 


0 


0 


0 


5 8 






Silver- 


0 


6 


0 




22 


0 


0 


0 


0 11 



Burdctt 
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Table € (Continued) 



NinMbcr of 



LKkof Ittofkal 



Ofwk 
Levd 


CcMteat 
DoouiM 


PuMkber 


lUogictI 
SinictHn 


CooMctivcs 
or Unclear 
Referentt 


Se(|iieMct| 

EiplMttiOM, 

or PfoccdMits 


In«kv»at 
MeM 
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TeiM 


Hgunlive 

1 iimmt 


FalM 
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UmiecesHiy 


Hard to 
See or 
Undeir 




PLANTS (Coot) 


MenUI 


4 


9 


0 


6 


15 


0 


0 


0 


9 


10 






Silvci^ 
Bunkit 


0 


1 


1 


1 


10 


0 


0 


0 


0 


0 


4 




MeniU 


1 


6 


0 


13 


18 


0 


0 


0 


10 


S6 


4 


SOLAR SYSTEM 


Holt 


0 


1 


0 


1 


7 


4 


1 


0 


0 


8 






MeniU 


0 


0 


0 


0 


2 


2 


0 


0 


1 


2S 






SUvtr- 
Banktt 


0 


4 


0 


2 


12 


2 


0 


0 


1 


9 




WEATHER 


Mcannir.HiU 


3 


10 


0 


8 


10 


0 


1 


0 


4 


8 






Menill 


1 


3 


0 


6 


20 


2 


1 


1 


0 


1 






Silver- 
Burdett 


0 


11 


0 


3 


4 


0 


0 


0 


6 


12 



34 
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Table? 

Croif-Publlsher Comparisons of Inconsiderate Text Structure and Content In Common Domains 1^ Grade Level 



l4wl OBttlaai 



UdLof 



T«nM 



Mm 



hawM^Ptaifia^ 



Hard 10 Sm 
or Uackar 



rLANIl; 
ANtMALS 

flAHTM; 
ANIMAU 

BLBCnUCnVA 
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HUMAN iODY; 
SOLAR SVnCM 

HUMAN ROOY; 
WEAHIfiR 



4J(aj) U(U) 



9 

11 
f 



•0) 



4 

a 

10 
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MM) 



IS 

10 
S9 



27J(]0J) 



ERIC 
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TaUe 7 (Continued) 



Conifii Mkmm 



UnMOiiwy 



or UndMr 



ttLV»MJ1U)CTT.I9M 

1 KAKII; 
ANfUAU 

a rtANIl; 
ANIMAU 



rLANTI 

BUcnucriYA 

MAONBHSM; 

HIA4ANB0DY; 

•OIARSYIIVM 

HUMAN iODY; 
WEAimfiR 



HOLT, mo 

4 BLRCnUCITYA 
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HUMAN lOOY; 
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MC0RAW4am IfH 

5 HUMAN BODY; 
WBATHfiR 



I 

IQ 

U 



131 



II 

25 



0(24) 2M(IIJ) 



U(l.7) 



t3 
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15 



19 



21 



2(A) 



4i(U) l5J(»i) 
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Figure Captions 

Figure 1. Heuristic Mod'*! 

Figure 2. Annual Data Collection for the Heuristic Model 

Figure 3. Plots of Two District A Teachers' Minutes Allocated to Decoding. 

Figure 4. Plots of Three District B Teachers' Minutes Allocated to Decoding. 

Figure 5. Plots of Two District A Teachers' Frequencies During Decoding. 
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Figure 1 

Heuristic Model of Reading Comprehension and Science Knowledge Development 
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Figure 2 



Annual Data Collection for the Heuristic Model 



Classroom Management 

(9 Full Day Observations, 
Audio Taped) 

1. Time in Activities 

2. Organization 

(Whole class/GroEfips) 

3. Praise/Corrective 

Statements 



Student Ability 

TimeO 

(Fall) 
Multiple Measures 

Norm Referenced 

Criterion Referenced 
Individual and Group 

Assessment 
(Many new measures) 



Home Background 
Parental Occupation 
Parental Education 
Hours Parents Work 
Number of Siblings 



Materials 

(Reading and Science 
Programs Every Page) 

1. W^iat is there? 

2. How is it presented? 

3. How '^considerate'* is it? 



1 O 
4 o 



ERIC 



Independent Reading 

Student Reading 
Interest 

Opinions 



Instructional Style 



Teachers' Presentations 

(9 Full Day Observations, 
Audio Taped) 

1. What kinds of interactions? 

a. Procedural 

b. Text-Tied Comprehension Student Ability 
c Scriptal Hme 1 

d Decoding (Spring) 

e. Word, sentence, Muhiple Measures 
paragraph reading Nonn Refcrenoed 

f. Inferential Reasoning Criterion Referenced 

2. How are turns distributed? Indtvidual and Group 

a. Individuals Asaeauient 

b. Small groups (Many new measures) 

c. Whole dass 

3. What kind of feedback? 

a. Sustaining 

b. Terminal 
c Confirming 

4. Seatwork 
a. 

b. Quantity 

c* Student Performance 



Home Influences 

(Spring) 4 
Support for Literacy 
Support for General Science 

Learning 



Figure 3 

Plots of TVo District A Teacliers' Minutes Allocated to Decoding 
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Figure 4 

Plots of Three District B Teacliers' Minutes Allocated to Decoding 
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Figure 5 

Plots of Two District A Teachers' Frequencies During Decoding 
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